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PURPOSE: A method for 
recognizing speech by using a 
hidden Markov model having 
distortion density of an 
observation vector is provided to 
consider time structure of 
observation sequence and 
characteristics of LPC- 
cepstrum. 

CONSTITUTION: A codebook is 
made by quantizing each vector 
from training data(31). The 
vector-quantized training data is 
repeatedly re-estimated until a 
model parameter reaches 
appropriate level(32). A state 
sequence is segmented by 
Viterbi algorithm for generating 
model parameter(36). Distortion 
density of training data is 
estimated based on the 
segmented state sequence 
(34,37). If data to be recognized 
is inputted by using the 
codebook, the model parameter 
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and the distortion density, the input data are transformed into an observation 
sequence by using the codebook, so that likelihood obtained by Viterbi algorithm, 
segmented state sequence generated by the Viterbi procedure, and distortion density 
obtained from distortion of an input observation vector are operated for recognizing 
speech. 
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s ^go p^^^(Distortion)M Olgff g^eJ^Oil &m AH . ^ *JEi°! 

Qr^£ (Distort ion) £(densi ty)g tBM Ph3H e^(HMM)2J ^^3I§ A| 

□ ^^(Distort ion) ^M^5E (density )M ^gg AO2JEll0|£ A|^g E+^l : 

^EH AHI Ell 01 <^ ^ ftf6&& A|^« 2r£8K)| 2| ^EH joj g^zj 0 | miS ?6Fte BUM 
#EH i Oil A) 21 S^Sf AlZf ^PZI J PhP «JE| ^ U M ^6r^ : . 2^2| a^aS AIH^ kOil Q\ 

oH 2* 6fEH I Oil AH ^| Ale} ^ J QhQ g 2 wig Oil a» Q^Sd e i jkM ^Sffe £ ^ £> h 

eh ioiiAisi §^if Aia^a j ohp s k^H^j ere aa- ^ehm°i p^sfi e s±atu,>j» aoiatUj) 

OFa »0| e »SS H^&j HMMOII U|6H U8 oiai M ~ HSeCh 




^*^EH2| P^££ ^M^£(Distort ion density)g 0r3^ 2 IJ (Hidden Markov Model )M 

oieth §goiAi 

HMEte P^Mfl ^S^£M ?S^| B3IM gg6PI ?ie £^Mi , 10B3JL 12B3I. 14B3IIS 

ni2£^ p^sa ^s^^e ^spi 9\m &x\m «aspi 9ie ssjw. tee*, isb^ii. 20B3is a 

S6PI £0IP. 

^II3£^ S s S Oil AH ^?^6fe HMM/Distort ion ojai^oj ^-^§oj M bh poiOiH^OIP. 
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H4£te HMM/Distortion 21^\°i °J^a§°l aoiCHHSOIQ. 

^LSPIUf ^2°" mm ^AHSMIfe Br»«IE12| P^£^(0istortion)S Olgg} fg 

«J — i mi «rf er ^ u | Lr . 

ilSfJ £ SS tirne W arpin Q Plg(DTW). aja a»»(vector qaunt izat ion: 01 
VQplg. » 0>3* SBKHidden Markov Model: 01 Sh HMM)SOI g^pjA, gggo f OII ^g£|I2 °i 

01 ftCWAHE a 0 | a 0 | ou o^ S EH (HMM)° «a|3H2| ^HHgS Stl^og BUsfSffer ggog 
AH. a»LH2| USSOIS S4»»e/dE CK>2| SWspeaker independent )S CH^°E ^ oiaV3T» 

structure)* mXH=l(inDlicit)£SU SS(expl lcit)SMI SHS3>Blfe AieSAH UEf^D 01 a w A 
aaiffl ^50)1 °!SHAH UEH4te SSOIfflM(acoustTc events Al5J°i iT^APKdufanoS 

aaia ojan s^(hmm)o)i aenacn ea §g o,a, bs aoiI2 o) a anon ^ - 

E OK SOU 3)|AiOI ^SoHZUH *JS^0|I| 0H5He^( pa 7an.etr ic)ilia I 3*35" 

si* fii^i ^ssHOt ^ajso, x, sh g s|g ^oirj. naLf o *:«r*ifflE »?a1* 0 i*»^ 
s^oiife. ewsKaw »fe eg eoHs.oj eg ^ehoii cHSKxiaaiE »A"riAoV»a» £ 
gjcffe 3f S oi a on one* immcn= smsoi ap. ^~ t = s 

2^/5 = MX*® ^22f. BSWEISI -Si 4= 2Jfe a»*IEI2| 

£ :yi?t? rt '2! ^"t!^* * a gt=l ^3Haiy(HMM)(0loL HMM/Distortion)S 0IS& S«8!^S 

^rloLcf^f r F^?L?' 91 ^ §S2!4!gfaS ^oEIIOIEfS wiggJaSAI* 2E^i &}| ffljEI 

« ail raas assnn. 401 Aiinasg ^ehais-. « 3) iiaoiaa fEi-s^ fmmm 
oisk ess sssfoi e use aa ^absi ^s&a. 

SISL^' 3 ^j»S«l^fc ^sQIOIEfS SiiHgfXfSfAISI 2E^i Eh«3. 4,^1 ffl|EI8f»a=i *^ 

a» aso, 401 Afinega ^EHAin-g ^^aoiaVp^sa rfusV SIS 

o, k -,??! T f f/ 2f§0IIAHfe HMM/DistortionS OlgsfOI Srlf Alfj^gg m^Sl * ej^^§o)|AH 

?)oh si safe maoiEite aasia hmm°i ^ehsoi ^5, iS5n 
^x^I^i 8 ? 3B acK ££ °°' ™' a swa B5fi(3D^¥a aa°i »aDia(32)^ 

5' a ;sS 111 !:3."S3 i a Sffi%8Sg-A" 2 i!'L l 3! iS?,» B ."Si'2 SS ?s 
S^^SVSSSA a « VA^f.^ Vi, " bi * M ' S5» - Sa-3 

«3| AJ|3BjHI0l<y B3j|(36) 9 B& 1 nfaOIS(39)« ga»2. 01 Alffl^S 4>EM A |^JA.f3S)s ana 
OI^IAH HUES! «|2E0ll EAIg CI^S^ *rM^E(densi ty)» ^gfg ggg gEH AJ|3«»i HIOI^ AI^J 

am. * tfauxMsi Ai^j (j) om aaflaT?,,))!! ^ ^T(^if : ^|^ ( ^| 

a AI9^(k)0H CHSH 2| 6rEH(i)0||/d°| S3» A|^ ?ZHj) DIP ffl^Hj Q0 || nist r|^e^r pik ^a 
a S 5l^2i(/7, ( )a sICHaUjJB B3fl(18B3fl)a. CI^M^ ^figE(Distort ion density)* 5 
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sife 3si (2ob?ii)s oi^oisd. 

^EHAonHEfloi^s ?sii= eonooeaDt aj^s we « 021 as Aia^ss uisuKviterbi) 

tt^aSOl 2|8K» AOeaiOltfS * »-H<=W% e»(Backt racking procedure^! 2|SH 2^21 #EH AO 

aaioi^ Aigj^a gta. &;>i hme°i ( a )i= hiehui vnasoa sjsh ar-sav ais^i *eh 
aobehioi^ a iai mcx^^ sjcl h^si, 3^«h as ais^oiiai &eh 221 §jopi 021 s^s m 

SiCim «fe=0). blEHtil S» ^8 *2| gJUfe HM£2| (b)Sf ag Aj-g) a|«±S 

UEHHOtaa. Ol CHI CHgf 4) EH Allstate duration)^ £t;>| HI1E2J (c)£1 ^01 L1QIJCH5JQ (MIS S 
CH 3S!H 3S A|g!±0)IAH &EH 12| IJOIfe 3SSAH 0(3=3 °£ LIEILHoI SICK 

aSAIft^Oil CHff a* £EH(i)2| geaO|(mi)> (&| 1-1)0)1 2|SH ^81i= Ehfll ( )fe CISa 



t 



i A* 



Al" 



1-D 



a om soi. #eh 121 i2 iJoife? 3, #eh 221 sesoife 20m. ajqj aeaoi(mi)» nasioi ^ 
s jobeiiois gja«B. ssaoii °ish 3ss aib ?am sage*. 

SESh 4,01 (±J 1-1)011 AH SSI 811= 201 12 SOIS =?&Q£ BgOIIAH S3 CH ^SSICOE » 
4= 2iSU. CI±S£2| *fBiJ£(density)B HH . &EH XI^OI 2ife o< k =0 2J S^)2| mm 

gJ£fe IDS ?!3fK°H£ 4PI (±1 1-1)31 ^01 §2|S1fe 201 28l£^ ^gsfQi g- 4. °m. 

H10B3I2I at &EH(i)0)|AH2| §^£f AI2H?ZHj)0m 12 0|J )a (±. ,-2)21 (&| 1 _ 3)0 || o, 

SH ^Slfe B3ll(14B3j|)fe IIP-. 



f,,r ' * 1. 2 A ■ . for /= 1. 2. 



f - f/.i. 



E./.j 1-2) 



0|)» 2¥ CH& fl. 4fEH(i)0||AH2| §^,118101 j £i!HB AIB ?B2| ojsi^^ tfeh ><oiC1 ° " 
4,01 JH1E2, (e); = ^s^EHa u )m SOH ^2 aid. B B a) EH CHI AH 2| 4, EH & AIB a 0 , 12 

B5IICHIAH ?6D5J iJ Ol « J|^o S ^^oj mm A\m±m ^EHfflS §,,218101 ^ §ff2) Ala ?B 

rf.,c-l)> j, (-:,) 

Oil CH& SB ™'EHM OflB SCH y 12 g, a& Alt! a 12j aa| 



«/,2( = /. , )^ „ I > ( = 2) 

a. as aib^ 221 &m Aia asf A!fj ^ k2) 

./,.( - 4)- » (•-.!, 
1 

2|2|2i s.^as Aia±( k )oii cuoH ^ ^skdmaisi §*tt aib ^a(j) dip 12 bjehoii ch§j c\± 
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^£(eijk)S Qmz\ (a| 1-4)21 1-5) » HoH e3ll(16&5j|)^ PM^ aP. 

for i 1 . V* . . j* 1 . X. 3 nil 

' <'■• i 1 % rf - - 1 ' 4 ' 



(thinner (r, . . c/, *) . <A*-Mi ( 1 ! ' 5 



#31 «I2£2| (b)i=r 9« Alffl^SI gEHS Ala ?aom ^?8H£! P^SflS UEH4I3 5ttO. 0H> 
e,23^ A|^2| &EH 12| 2£HH Ala :?aOII oHSSrte 3»s*!E|2| S3*IEI U 12 0il Qj 

& >i ai (distort ion)M UPtdP. (*J1-5)2| distanced LPC-S^^S 3l^2J 3^z= ^Mdl PPJ 

»PS A r gK 4= 21P. o\7i\°} MM^ A|^§y M0\\^ PPj >id|2J 3||a^0II 5§J£j0j oi^ 

aiaea as pj^g 4* asm aro^ eid. p^sa «r«B£« ?s cchchi^ aizi ^a akdisi ^ch 

SIB! >iP(Distortion)°K)l HfioPI ttH^OIP. 

2* &EH(l)0||A|S| AIZ!^ZHj)PP g kJH2J ^1^012] P^£« g OI-EH (<N 1-6)21 (£J 

1-7)011 2j6H a^3KA|)ar aai»Uij)8 BaioseaDte: peuf ath 



M.\.\ .i» . I -A- A' . |r:./-.;^ ; . | iwV. A 1*1 17 > 



£>0| «2E2| (c)te 40| 18B5II2I 111 LfPLO SID. 3 XII K3H2J m^^m AIS^OII □^S^01 2j § 

s» Aizj- ?yom (Distort ion)si saiaa 2l£aS ?eo. 

P^££ ^M^£(Distort ion density)© (HEH2I (^11-8), (^1-9) §J 1-10)M S6H ^8rb 

Eh^K20E+^i)^ aem ap. 

fur- i 1 . 2. 3 N . for j ' 1 . !?. 3 ;,/, 



. (>*— I) (.X„ - >*„) ^ ft , \ 

•! 0 (if ontys^S) )<?2 



. ( O/ "7; 0 . othcrwisi; 



4tD\ BI2E2J (d)01l £AI9 tiJS» SOI P^sa HSE(Distortion density)^ S^sf AI3 

^(normalized frame)CHP ^XHelP. P^§^ ^(Distort ion density)^ 

^d|(distortion)2| £|CH2i AFOIB SDW°\ ^e>o^ UV01 ^ AIZJ- =?^}9\ &m *\E{9\ 

>I B-l (distort ion)3h &D\ 7] £| (distort ion) ?2Hs)0ll ^6f^ ^H^(^ k ^ Stf A|f!^S|)g 0|g6K)j m> 
M^SE(density)B aaBD. 

OIIB MCH. Pn(2)^ ^EH 12| IBM Ala ?aO0/H distortion =?& 2D\ Xtxmti mMW UEfLH 

^ 3o^AH. e m V&i e„ k 7?rX|2i distortion gOilAH 2011 JW^m afll(K)S ^01 P. 
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?a son sagas oia °ioii ^i la. ^ 2 " 0II/H ao<Ufc gf01 6SCf mi oil ^ 

fll4£fe HMM/Oistortion S!<\':>|°| oiA.^go, gej aolOO^OICf 

»(44)2| iJ!|o, >yi3 ^ Ell 01^ ^ ^ EH A^J^ r^of If^f-^ " SBf Viterbi § 

a*,,,™ p iM „ s „„, fla „ f aasl 3B3jla * °- 

3 &!flH B^IOilb Viterbi |^£|io § o. a ai«>.« A . cu fJI _,^ n 



, '= (iistnmr If.. (• i 



• if. f /,= o 



S ^ £J ^SOKioo-iikelihood score)* Q§ aoi gi§Q 



sssasss 
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P±££ mm^^m SN0>aHei!(HMM/Distortion)8 oig^ s«e!*i»Boii slouh , fi>£Q|OI 
EfS *JE|gJ»SA|31 ^12, £P| 9*iE)S»Sa §[^Q|OIE}°J SHmaOHEiS XH^St! ^. 

uiaui liaison 2joH &WM^±m aobsskm saintatoiiEiB asam, 4^1 aii391m^ &ehai 

3E^i 01 g 6101 oi^Qioieig »»Aia^S £1UI31, hi I EH H I SMQ£|§0|| 2| 6H ^oWB mM(p( 

o\A))a, £>0| blEidl 3»0|| ojoH Ai|321M& &EHA|fi^2f ffljE) (LPC-gj^Mg )2j 

2 

hi is 01121 £>oi ^^msaiiAH , a±^M mm^^m gjgjg &>eh /dizieteioi^ ais^b =? 

6H= £TEH All 3 B!! Ell 0I£9 A\m±m S 28*01 2| £JEH(i)°l S21J0|(mi)S ^PShte 

&D\ gEH(i)0||/HS| §^1} AIZI ?2Mj) CUP g5 a!|E|( £/„)■ ?8U= 2|2|2| Sf^BS 

Ais^(k)oii cue a>tsa(eijk)« ?»fc bm; » ^ 6ra(i)oiiAj2i gs» Aia?a(j) am a ion 
21 c?e as 9!|eh msi p^sa § s^»</iii)j» aaia(jr„)» &*is sewt 3is ^§2^ 

»n»2i ej^msoiiAi , p^sa ^m^s^m asAi^ife tii eh hi analog 01^ ^ s A) 
^— m #eh AoeaioiflSKM at &eh xi^um =?mt: bji; #3i ^ ^eh(i)obaisi ^ Sfm Aia 
( j )Qhcf at 6 eoii ^ohs aa«ia( u^si >iai« ?mo\ e,^\ ^mtz ^2Hs)§ l§el ^ 01 

^ZHs)* AjOil QlgJoK)! ^M(Aj(s))e ?8>te BJI: §y 2i*iSfBSI ^3-^0ia^H ^3CH(log- 

I ikehood score)* S»8*te 2!^ ^S^^ 81 te SaeJATSB. 



svs/y, 



(L 0IMENS1QM) 



1111 22...NNNN dii = 4,d2i=2 dm=4 



■iii 0-;^ ^r— 



r \ i \Vv 



s7T tTT <~xl\k V 

:\^>^>>iS n22...NN'NN d^=2,d 22 =2 dN2=6 

/ s ✓ y 

" 111...NNNN dii=3,d23=0,....dN5=6 
— d» =0 















A 




V. l .. 

4J 








I11I22...NNNN d , K =4.<fcK=2 d«=5 



STAliE l » I » 2 



' rriM I 
-i 1 u. 




(e.g mt =3,m2=2 mN=4) 

(e) ^Ei 



(L OlMCNSION) 
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(a) VITERBlat] "jm ^ WAPMOVl 



1:1*1-111 1^1: U 



Vij 



— — e»j 1 | Ui 



~ ^ 1 i i I i I 



(b) ^AS^PJTJ Ci±££ 

(e.g m1=3,m2 = 2 mN: 

STATE «=1 2 N 



4) 



12 3 4 
I I I I 

MM 



eij3 



nun 



_LL 



TT 



TT 



(c)£l±/50 C£§£ 



1 -- 



Pm(s) 



(d) n^sti arasE 



s / s 
/ s s 
S S s 



.' / / / 
/ / y / s 
s s / / 



1 1 1, 



/ s / s 
/ / / s 

S / / / / 
/ / / / / 
s s s / 



-d 4 



TIL 



S-1 



s I 



nn 

3±£ 



xn— nn 

S" " 



SCHZJ 
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^:hioieklpc-s±^^) 



log-LIKELIHOOD 
SCORE 

logP(q, OA) 
jjg log[pij(s)] 



42 



( =ic:otoj^ L — 
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